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ABS URLCT 


A tree-Structured muitiprocessing system design is 
proposed in which process communication is the prinary link 
between processors. A hardware cluster, cailed a Processing 
Module, is proposed as the basic structural component. 
These modules literally "plug together" tc form a system of 
arbitrary size. Each nodule has ittS Own memory and runs its 
own hierarchically-structured operating system, the nucleus 
of which iaplements P. B. Hansen's communications primitives 
along With process creation and remcval. wcrklicad 
stheduling and process location are performed resursively in 
the syster's tree structure. Multiprogramming 1s 
implemented system-wide, aliowing processes to migrate away 
from overloaded modules. It is argued that the resulting 
system would be truly general-purpose and iS subject to no 


limit on its size and conseguent computing power. 
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L.  LNTRODUCTLON 


A. Pevorcl LESCKRLPIITON 
1. The Epobler 

{This thesis project waS undertaken to explore 
whether a parallel processing system could scmehow have as 
its operating system nucleuvs a process or grcup of processes 
Which would act as a data bus for all other processes in the 
systen. Usually, communication mechanisms are centralized 
in one processor, but, in order to assure taximai 
independence of processors, it is desirable to somehow 
decentralize the bus function, as well. The probler is as 
fomleas: given that a general-purpose multiprocessing 
system can be governed by an operating system which is 
Structured as a hierarchy of processes, is it theoretically 
feasible to implement the communication of processes at the 
very lowest level of that system and continue to maintain 
decentralization of control? 

2. Extension of Unirprocessing Concepts 

Fron the outset, certain concepts appeaced central 
to the rational design of operating systems, but it was not 
clear that their application to a structure having process 
communication as its core would prove truitful. Nuch of 
what has appeared in the Jlitexature about the theory of 
process interaction and Synchronization was written in the 
context of nultiprogrammed Single-processor operating 
systems. The extensjon of these ideas to nmualtiprccessing 
poses fundamental design problems which do not occur when 
the objective is to keep a single. processor busy and 
productive. For the simplest case of two processors, 


various ad he¢ schemes can be devised to jcin tnem as a 


system with a shared memory. The prceblem immediately 
confronts the deSigner: which processor is to run the 
operating system? Or is there some gracettl way to have 


them Share this burden? Even if this ceomplex prceblem is 


satisfactcrly solved, it is guite likely that the solution 





will not be applicable to three processors, not to mention 
thirty cr three hundred. The difficuities of designing a 
multipie-frocessor operating system are partly those of 
asSignment. (Which processors are to do what and when?) 
Other hurdles are memory accesS RManagepent and file 
protecticn. Assumptions must be made, therefore, about the 
physical arrangement of the system. For example, 1S memory 
to be accessible directly from each processcr, or, fer that 
matter, is a Single memory the only alternative? A 
preliminary discussjon cf such design criteria 1S presented 
under OBJECTIVES OF PROPOSED SYSTEM (page 9). 
3. scope of Study 

There is a danger inherent in theorizing about 
design. the desire to provide concrete descriptions in 
order to justify a given proposal can lead research in 
computer systems theory treacherously close to "chasing hits 
around." Onemean “specifiy ther piysical structuce only at “the 
expense cf generality in the discussion. fifiornt. ehas» been. 
made in this study to provide a deScrifption of what is 
believed to be a feasible system, within the constraints of 
current and forthcoming technology. Aiternate means of 
achieving the same effect exist in many sections of the 


proposed system and are noted wherever possikle. 


be. DERPAILIONS 

FOr the purposes of this paper, the terns 
"multiprocessing" and "parallel processing" shall be used 
intéerchangeakly to refer to Simultaneous computation on two 
Or hore processors. The independent functicning of 
peripheral IyO devices is specifically excludea from this 
usage. This forcing of synonyms where Some writers prefer a 
distincticn is to provide for readability in sections which 
deal with both multiprocessing and multiprogramming. 

The tern “process shall be used without fcigorous 
definition. Since the concept of a computational process 


varies widely, the following constraints will be applied now 





and elaborated upon when necessary later yn 6 tthe 
presentaticn: 

(1) A process is distinct in that it has a name and may 
communicate with cther frocessess, subject to system-wide 
limitations. 

(2) A process can be created or removed (destrcyed) by 
existing frecesses. (The distinction between the creation 
of a process and the activation of an already-existing one 
is that creation involves initialization of associated 
memory Space and assignment of a name.) 

(3) A process "exists" as a named sequence of 
softwareyhardware states in one processor orf as ae stored 
record knecwn to the system and recallable fcr computation of 
its next state. 

This third constrajnt on tne definition of process is at 
Variance with recent literature on the subject [Ref. 11, pb. 
11J with respect to a process existing on one and only one 
processor. it is appealing to speak of some processes as 
being "ccmposed"® of two orf more other fprccesses cr of a 
process "proceeding" on more than one processor. ‘Dhoes 
extension, aS it turns out, is not universally feasikle or 
desirable as a system deSign feature, even though such 
abstractions may be valuable from an analytical fecint of 


View. 


Co RN ASSUUPTION 

The primary assumption under which this study was 
conducted concerns the rapidly-declining cost and 
Space/weight factors associated with Large-Scale Integration 
(LSI) circuitry. Whereas presently, massive efforts are 
made in Order to gain a few percentage points of utilization 
out of a single CPU, it is assumed that in multiple-CPU 
systems cr the future, some processors may stand idle for 
well more than aAaif of the time, if for no cther reascn than 
that the ccst of redesigning software will be prohiritive 


compared to simply adding more processors. Factors such as 








reliability, versatility, maintainability and expandability 
are expected to become the main concerns. Processors are 
already being marketed [ Ref. 12] which, exclusive cf nemory 
and power supply, are confined to a single LSI "chip" and 
cost less than $100. A computer system can be fabricated 
which will fit inside an attaché case, plug into a standard 
wadds outlet for ».power and attach to»a standard "teletype" 
keyboard for input-output. In this context, a system having 
a relative multitude of processors may not be particularly 
expensive or bulky by today's standards. In terms of the 
so-called “large systems" in use at this writing, the systen 
proposed in this study might appear preposterous. If the 
foregoing assumption preoves correct, the proposal will more 


likely be a modest one, indeed. 


Ger eo bab CTIMES OF PROPOSED SYsaEs 
1, A General-puzpose Systen 

The systen to be described in this paper is cffered 
as one approach to general<purpose multiprocessing Ssysten 
design. Recent systems, such as ILLIAC IV and STAR-100, 
1muplement parallel processing but are something less’ than 
general-purpose. For example, ILLIAC IV dedicates 64 
processing elements to the task of array precessing under 4a 
Single ccntrol unit, an efficient arrangement for vector 
Manipulations of appropriate size but a limited one in the 
sense that the processing elements cannot he assigned to 
diverse frocesses simuitaneously [Ref. 3, p. 76). SAB aai0.0 
is a distributed system in which specialized computing 
Stations perform the various functional tasks demanded by a 
user program. While more flexible than the ILLIAC IV, it 
1s not clear that the STAR system can eaSily perform grid 
operations, wherein thie calculator” of one “peineeeis 
dependent on the values of orthogonally neighboring points 
[ Ref. uj. The primary constraint cn the fEresent 
undertaking, therefore, is that tne design provide for 


Gerelal-pappese pawakliel pmocessang, capabixe of emhanced 
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thrcughput fcr the preoadest range of tasks possible. 
2. The Large-Proqran Problen 
large computing systems are justified primarily by a 
relativeiy srall number of large jobs which require the 
system's entire computing power in order to run at all. The 
intreduction of muitiprogramming in large wuni~processor 
systems does not alter this determinant. Improved 
turnaround and enhanced utilization of the CPU are 
advantages which accrue to the smaller job classes, but the 
largest jobs appear more as "short circuits" to the 
multiprogrammed operating system. AS a result, growth in 
these systems has been in the direction of larger amcucrts of 
on-line memcry, particularly Random Access Memory (KAM). A 
more desirable solution to the "lLarge-program" problem is to 
find parallel sequences in the program itself and submit 
these seguéences to the multiprogrammed operating systen. 
Prong such alteration of the gop itself, there seems ilittie 
else that can be done except to switch to nultiple 
processors. The pattern should be clear, though, that no 
matter now capable a system may be, someone will write a 
program that will require more than tnat system can handle. 
That is, no matter how many processors are available to a 
System at any given time, there exists, a priori, a progran 
that can bog it down LOE hours on end. Again, 
multiprogranming | of those several processors will not 
provide an escape fron the situation, even though it will 
tend to optimize CPU utilizations for smalier jobs. From 
the standpoint of design theory, systems must he devised 
which treat processing power aS a variable rather than as a 
fixed consequence cf the design itself. With proper design 
development, the lagrge-~program problem can be reduced to an 
economic constraint, avoiding the need to abandon one desian 
after ancther, simply to gain more and mcre precessing 
POWEL. 
3. Process intera 


Although large programs dictate the gross prccessing 
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power of a system, they are not necessarily the only ones 
which deuand greater generality of design. Cn the contrary, 
the manner in which oniy a few processes are reguired to 
interact can also determine the sufficiency otf a given 
system. Thecretically, the sharing of resources in real tine 
is completeiy analogous to the time-mulitiplexed sharing 
obtainable on a single processor. Live Jas eso) 1 he de0 Ut 
earlier, the several parallel processes are not indefendent, 
an effect is encountered Similar to "thrashing" in the 
execution of a page~fauit algorithm: the successive 
blocking and restarting of each process in a large group of 
dependent processes reguiresS a Significant amount cf systen 
Noverhead" as a necessary conseguence of having only one 
processor. Nor does the use o£ multiple preceéssors 
guarantee an improvement. The communication scheme which 
accomodates such dependencies must be efficient itself, else 
the operatine system will continue to be the bottleneck. 
4. system Hierarchy 

BE. WW. Dijkstra, in his description of the "HE" 
Muitiprogramming System [Ref. 7, pe 79), argues for a 
process hierarchy in which process communication is 
dependent on two lower levels of primitives," tasks 
callable Ey higher-level processes (see Table I, page 12). 
"Level onet*' contains the segment ccntroller, enabling 
proklems cf memory nanagement to be treated as being 
invisible te the communications rrocesses in "level two.'* 
Beneath the segment controller, at level zerc, the processor 
allocaticn process runs, renoving from all higher levels any 
concern aS to when (or where) they will run. [In the ccntext 
Of multiprogramming with a Single processor, possibly even 
with two or three processors, this last aspect of Dijkstra's 
particular hierarchy is deSirable. But, for a system with 
many prcecessors, there are advantages to allowing certain 
higher-level processes to specify processcr requirements 
dynamically, as in the case of dependent-element array 


processing. Hierarchical structuring of system fprecesses 
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remains a powerful basis for design in any case, ELut the 
rearrangensent of minimun-system processes, at least at the 
lowest leveis of that hierarchy, can Simpiify the design 
transiticn tc parallel processing. The attempt made in this 
study iS to aSSign communicatica processes to level zero, 
allowing all higher frocesses to communicate with each other 
without any direct concern with how that communication is 
accomplished. An expected benefit of this arrangerent is 
that system-wide scheduling can be more decentralized than 


would otherwise be possible. 


Table I. Dijkstra'ts Hierarchy 
0 Precessor Aliocation 
1 Segment Coatroller 
iz ifWessage interpreter 
3 iG rurrer Concerol 
4 Independent~user Programs 
S 


Operator 


5. Cennuprcation Primitives 

Given that the lowest level processes are restricted 
to communications, (ViZe, 2nterual camnunicatreme, “not 
Systen I/0), the definition of communications prinitives 
must be considered. P. B. Hansen [ ket" 10, pe 233 ]"has 
offered a grcup of four Such primitives: Send Message; Eait 
Answer; Send Answer; Wait Hessage. Taese prinitives are 
executed by a group of processes (software and/or hardware) 
Which manage a pool of message buffers together with message 
queues for each process using the primitives. Once again, 
the ccncept is one formulated £or Single~CPu, 
multiprogranmed systens and reguires some manipulation 
before it can be applied to a feasible multi-CPU systen. 


Hansen's four prinitives are considered logically sufficient 


| 





for inter-process communication. One of the objectives cf 
the proposed design js to assure that they can be- solialy 


integrated with the multiprocessing environment. 


1.3 








eee RESTGN PHILOSOPHY 
i. Design Nethodology 

fhere are two design nethodologies which are 
generally used in operating systems development. One 
approach is that of supplying user-desired features by 
Gefining the primitives available to user frograus first, 
thereafter defining lower and lower levels of primitives 
Within the operating system until the zero-level "nucleus! 
is reached. The reverse of this "top down" procedure is the 
“Hottom up" approach, in which the lowest primitives are 
defined first. Since the thesis guestion itself involves a 
specific constraint on the Jowest level cf primitives and 
only general constraints on the highest, the latter 
technique was adopted in this study. Clearly, the tzxo 
methods are complementary, and neither may be employed 
without regard for the otner. 

2. king Structures 

One design goal deemed paranount trom the beéginning 
of the project was the innovation of a multiprocessor 
structure which has no optimal number ot processors implicit 
im the structure itself. Various abstract models rere 
considered, the first of which was a "ring" of processors. 
Such a system could be implemented in at least t¥vo ways. 
One technigue is the “daisy Cchain."' Each proceSsor passes 
messages aiong to its neighbor, under this arrangement, and 
Pe Seceiving process (or its proxy, if ait is curnnentthy 
dnactive) ends the chain in each case. The rate at which 
messages move about in this system would te unnecessarily 
Slow, since each processor must pause from productive 
computing for each message peing passed through it. The 
more processors in the daisy chain, the greater the nunber 
of processors which must be "traversed" by an ever-greater 
humber of meSsages. Another, more efficient means of 


implementing the cing structure is to provide each processor 
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o— ‘tmertis senbesiacc with eae tang Of fastesnift.registers. 
Here, each interface can perform the task of address 
recogniticn on behalf of its srespective processor. The 
feasibility of this approach has, in fact, been shown {[kef. 
8); The ability of this system to withstand unrestricted 
growth in the number of processors in the ring is not 
unrestricted. As the circumference of the ring grcws, tre 
increasing average distance between communicating pairs of 
processors would slow the cooperation of processes and could 
progressively interfere with overall system throughput. 
3. Data Bus Structures 

Another type of system 1s one which requires a 
physical data bus to tie the processors together and a “bus 
process" to control the data flow. The speed of data 
transfer in such a system could be quite rapid: On Signal 
from the bus process, a Singie processor is given cecntrol of 
the bus tc pass a message or block of data directly to 
another processor Or peripheral device or the bus frcecess, 
itself. Alternatively, a multiplexing system could he 
imposed, dividing the physical bus into many time-slice 
Channels, assignable dynamically by the bus process. 
Questions of reliabiiity aside, the problem arises cf ho« 
Many processcrs could efficiently bte serviced: the capacity 
of the data channels is nounded by the bandwidth of the bus 
atself [ ket. 1, De 131]. Multiple bus lines are a méans of 
expanding the bandwidth of a physical data bus, but this 
escape 1S in the direction of extreme complexity GE 
hardware, if the bus is still to work as a coherent unity. 
Given that a system haS kK processors, the successive 
extensions of that system to one having K+1 processors, all 
sharing a common set of physical buses, will eventuaily 
require hardware mod} fication or replacement of the original 
processors. In any case, the sophistication of the software 
and/or hardware necessary to implement a bus for over one 
hundred active processors would be impressive indeed. In 


order tc extend such a bus Structure indefinitely, soneé 


ee 
Ss: 





means of decentralizing the bus workload would have to. ke 
found. Further study of the hus nddel was abandoned, Since 
the need for bus control and the need for workload 
distribution were seen aS competing goals. 

3. Free structures 

Attention was shifted to a "tree-structured" systen. 
The immediate prospect of recursion in this design model 
prompted a closer icok at modularity and component 
Standardization as system goals. The result expressed in 
this propesal is a system based on ae Single hardware 
cluster, called a Processing Module (PM), to which may be 
appended certain accessories, such as bulk memories cr user 
interfaces, without need for modification of the hardware or 
the software. These PM's are plug-connectable with each 
other in such @ manner as to automatically extend the systen 
mt chewrcCim CL a Graph-tneoretic tee. 

{Ih a tree-structured system, control functions can 
be prccesséed recursively: each node is under the control of 
one higher node and in turn 1S the sole ccntrcl for zero or 
more other nedes {up to a £ixed limit). Thus, the root node 
of the whole system need oniy be aware of which branch under 
zts control is responsible for a given process. That kranch 
i a subtree #iiose root node Knewstwhich Eranch under its 
control holds the process in question. Ultimately, since 
the system is finite and contains no loops, a node is found 
Which has no branches. This node must, therefore, be the 
M6eatiton of the process. Ne higher node in the structure 
need ke aware of this exact assignment, a fact which allows 
considerable economy in table space and lcckup tine at any 
given node. By extending these location tables at each node 
to anclude the priority of the process and by assigning the 
lowest priority to the null process (ie., the processor is 
free), the task of processor allocation is manageable ona 
recursive basis, as well. 

The following section deals primarily with the 


hardware requirements of such a tree system, starting with 
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the Processing Module. Once the "machine" has been 
described, various aspects of an operating system are 
discussed under the heading of SOFTWARE STRUCTURE. Finally, 
a aescription titled SYSTEM OPERATION covers the behavior 
of hardware and software acting together. 

Hereafter the proposed systen will, for convenience, 


be refered to as TREE. 


Be. TREE HARDWARE STRUCTURE 
1. Processing Nodule Design 
a. Central Processing Unit 

The Centrai Processing Unit (CPU) is envisioned 
aS a precessor of arbitrary computing fower. The word 
length and the capabilities of the instruction set are 
parameters which have no direct bearing on the feasikility 
of the system. Within limits, the power of the CPU could 
Giirter from one’ PH to another, Or, more practically, fron 
ene branch to another. As long as the internal workings of 
each CPU are invisible to the remainder of the systen, 
standardization of the CPU's themselves 1S not necessary. 
Strict adherence to the message/interrupt formats, which 
define the boundS petween processors, guaranteés this 
1solaticn. Variability in the computing power of the CPU 
orfers the prospect of technical improvements witncut loss 
of compatibility with earlier TRERF systems. 

Figure 1 shows the CPU section of the FM in 
relation to other components. The apparent multitude of 
Sonmections’ Ath the @PU are actually “of “cnly two types: 
interrupt lines and message/control lines. Interrupt lines 
merave at the CPU from three sources. One is frem the 
higher (ccntrolling) PM; another is from the Memory Channel 
(page-fault signals); the third is from the (CeeLzOna lye oul 
storage device. An ainternal clock can also generate 
interrupts. Interrupt Lines also depart the CPU to as many 
Subordinate P's as the CPU design will allow. fFcr the 


Ooutround interrupts, provision of externally-accessible 
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Figure 1. fhe Processing Module 
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flip-flcps, one for each possible subordinate EF is 
necessary. These in turn are an addressable array to the 


CPU's lcecic and instruction set. Inbound interrupts are 





subject to a priority scheme handled in the CPU hardware. 

Nessage/fcontrol lines are tied to Similar 
flip~tlcp arrays called the CPU software either in response 
to interrupts or in the normal COULSE of process 
communication and memory access. They are all addressable 
internally as an extension of the CPU'S memory Space. 

bk. Memory Channel 

The Memory Channel (MC) 1S a hardware processor 
which performs two distinct functions. In cne role it maps 
reilocatakle addresses sent by the CPU into run-time 
addresses useable by the PN*S memory. A vectcr One 
registers into which the hardware indexes 1S one means of 
providing the swift translations needed. The registers can 
be altered in response to control information sent Ly the 
CPU (when the Segment control process 1S active). When an 
address maps to a page not held in menory, MC hardware 
generates an interupt to the CPU (causing the segment 
control process to become active again). 

The other activity of the MC 1s aS a switching 
network for block data transfers. Block transfer lines are 
provided in and out of the MC comparable to the interrupt 
and message/fcontrol connections of the CPU. Alsc, each 
independent memory bliock is accessible by this network as 
is the bulk memory, if present. Under periodic control 
from thewGPuU, the MC establishes access routes between the 
superior PMN and any one of the memory blocks, between the 
Superior PM and any of the subordinate PM's, or between the 
bulk memory and a subordinate PM. The NC only enakles the 
connection directed py the CPU, The asSumrtion is made 
that the result of any Series of Such connections within 
the total system is to allow block transfer between a bulk 
memory device and a memcry block eisewhere in the system. 

Cc. Semory (ROM and RA) 

The memory provided in the PM ais broken down 

ijato indepéendently-accessible blocks. The size of these 


blecks is arbitrary, the major constraint keing that all 
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blocks in the system be of egual size. Some cf these 
blocks are Read-Only Memory (ROM). These blocks provide 
for immediate start-up of the system by stcring pernanent 
copies of the mininum-system software. The remainder of 
memory 1S Random-Access Memory (RAM). LAC Sane 1Cular 
technology used to ifplement RAM is not important in this 
context. Various features could be designed intc these 
blocks which, while not being necessary to the system, [er 
se, would increase itS pcwer overall. For example, it 
would be valuable tc be able to cause any of the memory 
blocks to input or output its entire contents at hich sreed 
and in werd-seguential order via its block transfer line. 
This feature would allow rapid menory-to-memory transfers 
without need for mediating processors. Ancther désirable 
feature would be a block-level file protection systen 
wherein access criteria are defined by the cwner prccess in 
part of the block*ts memory space. AJ1 processes not 
permitted access by the owner~dexined code are locked out 
no matter where that block is loaded in the system. BY 
extension, the access code could be used te encrypt the 
entire ccntents ot the block as it is being transferred out 
to bulk storage or to another menory. Generation and 
reduction of CRC parity-cneck codes are Similar 
possibilities in this transfer process [Ref. 14, p. 16]. 
2 Mcdele Inter€acing 
a. Data Lines and Channels 

Figure 2° {page 24) shows a possibie 
configuration of the TREE Systen. In tne figure, the 
Central Bus, the Proc (Processing) Nodes and the Bus Nodes 
Seeraut bu's, @ach operating accordang to ats relative 
position in the structure. 

The physical connections reguired between PM's 
in close juxtaposition can be achieved by printed circuitry 


or by flexirkle wire sets. The low Transistor-to-Transistor 
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Logic levels (TTL) used internally are completely sufficient 
for short-distance inter-PM communications. The connection 
of any branch of the system (whether a singie PHM or a 
substantial Sub-structure of PM's) to its controlling 
superior PM can be extended to any distance desired through 
use of MODEM's and a data channel. Since computation 
proceeds asynchronously in the various PM*s and the 
message/control and interupt structure are designed tc allow 
for this independence, the data channel has Ginimal 
constraints placed on it. 
be. Eulk Storage Interface 

Bulk "bleck-oriented"™ storage ¢€RORAM) can be 
connected to the PH on an Optional basis. The operating 
system described under SOFTWARE STRUCTURE presumes that ail 
PM's have some BORAM connected except those which have no 
Subordinate PM's. This arrangenent ailows the supericr PH 
in every case to control bulk storage for its immediate 
subordinates. [it could prove more advantagecus to frovide 
BORAM at alli levels and to ali PMts, in the event that the 
BCRAM activity 1S excessive and interferes with fErecessor 
Cireughput. (It would be necessary to design the Menory 
Channel to allcw transter from its attached BORAM te any of 
its cwn Memcry Blocks in this case.) Schemes for sharing a 
Single large BORAM system by all PN'S within a level or 
branch are readily imaginable but detract from the strict 
recursive structure being offered here as a general modei. 

c. User interface 

Another optional connection previded in the PK 
design enables conversational user terminals te be 
interfaced anywhere in the system structure. In practice, a 
Single branch of the system, rather than a scattering of 
P's, would probably be assigned to user terminais. Figure 
2 shoWs a Singie terminal for an entire system. Any of the 
Processing Nodes Shown could have a terminal added. 
Input-output for each terminal 1S programinable as a 


hagh-level process to be carried out by the PM whenever its 
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associated terminal is on QLine. The user thus has the 
benefit of a "smart" terminal, i¢€., one which handles I/O, 
edit functions, and some file control without appeal to the 
larger systen. Tne system, on the other hand, retains 
access to all itsS processors and 1s able to use any or all 
ee the PPM connected tosterni#mnalS on a fFrzerity basas if 
the terminals are on line. Each terminal-connected Pi 
automatically reverts to general system use whenever the 
user logs cut or when terminal power is cut. 
3. System Structure 
a. Eus and Processing Nodes 

In terms of hardware, all PM's in the system are 
identical. The tree-structured interconnection cf these 
modules creates a natural division of labor which is 
conceptually useful. The “ieaves" of the system tree, those 
Pri's which have no subordinates, may be thought of as the 
"Processing Nodes," whereas all PM*'S Superior te these 
leaf-PM's are involved with system management, especially 
communications, and nay be regarded cojlectively as "Bus 
Nodes." fhe system is essentially a hierarchy of Bus Nodes, 
branching outward from a Single Bus Node and terminating in 
all cases with Processing Nodes. 

b,. System Input-Output 

The Bus Node at the apex of the hierarchy (the 
Gemtral Bus) 2s Left with a set of messageycentrol lines, an 
inbcund interrupt line, and a block-transfer line which are 
part of the PM standard design but which, by definition, 
lead to no higher bus. The input-output channel is given 
access Via this central interface with the systen. 
High-speed IyO devices are nultiplexed by the I/0 channel, 
which is under the control of the Central Bus. The 
interrupt line allows the channel to proceed independently 
and notify the Central Bus when an aSSigned I/O task is 
complete. The block transfer line aliows the channel to 
access Centeal BUS mnewony ve fetch. or ovéemhay.on a 


bliock~-at~a-time baSis. 
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Comer Systeme S pecaiacation 

Emphasis must be placed on the recursive nature 
or the system structure. Any PM ain the system which is 
serving as a Processing Node can at once be changed into-a 
Bus Node by connecting one or more new PU'sS and aée BOORAH. 
The degenerate case of a system consisting of exactly one Pi 
connected to an I/O channel is a feasible configuration, 
even though multiprocessing is not possible. Inspection of 
this uni-~frocessor system reveals that it is not very 
different from a "conventional" uni-processing system. The 
design of the PM is eSsentially a generalization of 
"classic" system deSign: the CPU has 1tS cwn Main memcry; 
main memory is backed up by bulk memory (disk, drum, or 
tape); input~output has independent access to memcry; and 
the overall hardware implements an interrupt structure. 
Input-output is the dink between a conventional processor 
and the TREE system. Each input and output Pere OF ‘GEC ac 
ports is assigned meaning by the software and hardware 
acting together. Part of that meaning is the hierarchical 
relationship which all PM's share. 

In light of the recurSiveness af the structure, 
apt. is possible to specify concisely the ‘cules for 
structuring a TREE system. Yo achieve this descripticn, it 
is useful to adopt a notation already in wide use for the 
description of context-free (itree- structured) ccuputer 
languages: Backus*Naur Form (BITE ves Since ENF is 
descriptive of possible linear arrangements of symbols 
rather than of the possible tree structures used tc arrive 
at those symbol strings, the following adjustment is 
necessary. The concatenation of two variables (represented 
by “e') ais interpreted to mean that the first is connected 
to the second. Should the second variable be a list of 
variables, the meaning intended is that the first is 
connected Separately to each member of the list. Variables 
which are lists are defined as such, using list notation. 


Table Id (page 27) gives the producticrs for 
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TREE. The configuratjon illustrated in Figure 2 may ~be 
checked ky successive applications of these rules. For 
example, rules two and three disaliow the connecticn of a 
new <PM> onto any <PM> which has a <TERKMINAL> attached 
already. Rule four implies that for a <P-NODE> to beccme a 
<B-NODE>, the <TERNINAL>, if present, must fe removed and a 
<BORAM> added. Any legal TREE configuration may he 
generated uSing these rules, as well. Since some variables 
appear in the rules connected to a non-empty list of 
Variables, 1ist notaticn Snould be used to linearly specify 
any resulting structure. The configuration depicted in 
Figure 2 may be represented by the following (abbreviated) 
statements: 

<SYSTEM> = 

<IOGROUP>eBe (P,P, Be (P,Be (P,P)},Be(P,PL,<REMOTENODE>)), 

where B is a <B-NODE>, P 1s a <PH> and ET is a 
<PHOe<TERMINALD. 


Table II. BNF System Description 


i <SYSTHHO w= <LOGROUP>*« GBR ACH 


Wee TS ERANCHS 33= <P=NODESR”|) <B-NODPe<cBRANCHLISTO { 
<B-NGDED>*®<REMOT ENODED 


3. <P=NODE> ::= <PM> | <PM>e<TERMINAL> 

4H. <B=NCDE> :2= <EORAM>*<puM> 

5. <BRANCHLISI> ::= (<BRANCH>) { <BRANCHLIST>U (<BRANCH>) 
6. <BORAM> ::= <DISK> | <DRUM> | <BORAM>*<HCSTORED 

7. <ZIOGRCUP <LOCHAN>©«<DEVICELIST> 


8. <DEVICELISD ::= §<LODEVICE>) | 
DEVICELIS@T>U (<IODEVICED) 


= <MODEMD> e<CHANNELD e< HODENM> e< BRANCHD 
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Block~-Crmented Random Access Memory 
fu teGi-~Capactty (Cn-i1ne) Storage 


Processing Moduie 

Ans Input-Output Channel | 

wiCis Card Treader, 19 ne pri ner, etc: 
BM; Modulation-Denodulation Unit 

NNEL: Data Transmission Channel 
COucauenat tons “1s connected ee" 

Union of two lists 
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Cee oeraganeE STRUCTURE 
1. Programs vs. Processes 

A very necessary diStinction must be drawn between a 
software prcegram ana@ the process it controls. This fact is 
pacticularly true in TREE. Aeprogrameryritten to implement a 
given process must be able to run on several processors at 
once. The same code on two different procesSOErS represents 
@eo distinct processes. This constraint 1s nécessary in a 
system which treats processes as named individuals, which 
can generate messages regulring replies. If the originator 
of a message is not distinct from a programmatic twin, great 
confusion can result: 

A process is not necessarily tied to its processor, 
although minimum-system processes are resident cn their 
respective processors. Processes are generally allowed to 
migrate akout the system. A message sent frcm one precessor 
may have to receive a reply at another processor. 

2. iessage Primitives 

The Main problem with the extension of Hansen's 
communicaticns primitives to multiprocessing is found in the 
handling of the associated message buffer pcol. As 
Originally fcrmulated, each process draws upon this pool 
when initiating a communication to another process (up to a 
Pecset damnit, to prevent “black sheep processes {fron 
capturing the whole system). Provided that an anSwering 
process uses the same buffer for its reply as was sent to 
it, communicating processes have a mutual identification of 
a given communication: the name of the buffer itself. 
Buffers are thereafter returned to the ccnmon pool. For 
communications which reyguire no reply, the buffer is 
returned at once to the pool. 

The difficulty with inplementing this buffer pool 


scheme for a large number of CPU's is that cf tenmory 
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access.! One means of circumventing the necessity for 
central memory is to ccmpromise on the buffer-pool concept 
Meselrt., instead of a single, central pool, each process is 
provided with an jnput gueve of nominal length within its 
Own memory. Whenever that length 1s exceeded, a scan cf the 
queue is performed to determine if the sending process is 
over-represented already. If so, the offending process is 
notified and/or removed from the system. If not, the gueue 
can be extended and notice of the overflow sent to a dump 
process for jater analysis. 

Identification of a communication, whenever to or 
more are active between two processes, 1S sonewhat more 
troublesome kut is resolved by the "naming" cf messages py 
the initiating process. The number of Simultaneous 
communications possibie under this arrangement is limited 
€lther by the size of the name-Space for which the 
initiating process has room or by the length of the nane 
field in the message format, 

3. System Hierarchy 

All frocesses in the TREE system are members cf a 
Strict hierarchy, a concept first applied by Dijkstra in his 
design of tne “THEO operating system {Ref. 7, p. 343). Each 
successive level in the hierarchy provides a new degree of 
eulGtional . abstraction. Level Zero implements the 
cokmmunicationS primitives suggested by Hansen. All higher- 


ey Se eS ee ee i ee ee > ee a re ee ee me 


 ,'A System capable of emulating the ILLIAC IV, having a 
minimum Ct 65 processors, would nave to provide some neans 
Or access for all processors to the main memory which weuld 
not. degrade the memory cycle time of the PLrOCESSOLS 
TRaividudally.. This reyuirement cleariy eéxceedS Current 
feasible technology. Memory would have to_ be coutinuously 
Gedaamte Dy ali processors, Simiiar to a large status Dead 
being continuously readable py all workers “in an office 


Space. while laser holography or some eyually exotic tediun 
bey Ole day fFrovidewthis kind of large-scale. Simultaneous 
access, a Gss direct approach must Ee devised fer the 


interim géneration of computer systems. 


20 





level prcecesses are able to use these primitives without 
further concern for the means employed. Ioplementaticn of 
the primitives is performed by processes residing at each 
PN. Higher-level processes need only call cne of these 
"system sub-routines" and wait for control to be returned. 
Nessages received at a subordinate PM are accompanied Ey an 
interrupt. Each processor's level ZGzc includes an 
interrupt-response process which can in turn loaad certain 
other processes in order to service a received interrupt. 
The interrupt structure is thus at the exclusive disposal o£ 
the zero-ievel processes. No process above level zerc 1s 
permitted direct initiation of an interrupt, and all 
received interrupts are interpreted by zero-level prccesses. 
included in level zero is a Message Queue Handler, whose job 
it is to add messages to process input queues, and a Frocess 
Locator, whose task is to pass the messages tc a subcrdinate 
or the superior PR if the addressed processes are not 
locally neld. Referring to Figure 2, a message generated in 
the Processing Node servicing the user terminal (lower 
right) and destined for a process unknown to that node would 
be passed to the superior Bus Node connected to it. If the 
addressed process is unknown to the Bus Node as well, the 
message would be passed up to the Central Bus. If the 
process exists, trae Central Bus will know which of its 
Subordinates is responsible for it and will recute the 
message tc that branch. The processor receiving the message 
from the Central Bus performs a Similar search. Eventually, 
the addressee 1s found in some subordinate's local file of 
processes and the message is added to the input gueéue of 
wat piroecse. 

Finally, level Zero contains a Erocess 
CreationyRencval process (to be explained under SYSTEM 
OFEBATICN). Because the zero level behaves as a rejatively 
self-sufficient society, it is convenient and prceper to 


refér to it as the "nucleus." fhe nucleus is identical on 
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all P's in the system. Hansen's definition of an operating 
system nucleus, allowing for the context cf uni-precessor 
systems in which it was written, is compatible with the one 
being presented: 
et ee ead and communication between 
internai and ernal processeS are coordinated Ly the 


system nucleus -an_ interrupt response progran w1leh 
ecommbete control of input/output Storage bee Secene 


and the Tike ras Mies = cael we do not regar sten 
nucleus aS an endent process, dut paseducit asa 
sortware eens one the hardware structure, which 


makes the computer coe attractive for mulitiprogramnming. 

LeseltUnNGt Lon 1S tO implement .@ur process concept and 

eee oes that processeS _can invoke tc create and 

control ; er rocesses and conmunicate with them. 

fMner. 16, p. 23 365 

The remaining levels above the nucleus provide 
Successive degrees of abstraction, permitting user-level 
processes use cf aS powerful a set of primitives as 
possible. The procedure of aSSigning processes to ievels 
admits a good deal of variation. More important in the 
Peecene Ccoutext is thewassdrance that the reauirenents of 
the tree-structurea relation among PM's are compatible with 
the reguirenents of each PH*'sS operating SySten. ia 
analyzing this interaction in the section on Svein 
OPERATION, the hierarchy assignments shown in Takle III 
(page 30) #111 bes assmmed. WS indicated in the table, levels 
zero through four are "minimum system" processes whose 
software is kept in each PM's ROMs. All other processes must 
ke fetched £rom backing stores on demand. 
4. File Protection 
Ne pcimtedmout Carlier, very S<cilce file  pretection 

iS oktainakle by performing access checks within the RAN 
(rand vabe) DOCK Unit, passed on a header cf infcrsaticn 
stored with the contents of the block. Another approach is 
to make only the access heacer available to the Memory 
Channel Control process wnenever the block is first flaced 
0 kA. The MC Control process can then include this 
intermation with the data it supplies to the MC translation 


registers. Thereafter, each access which maps to that block 
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is checked fcr proper credentials and an interrupt generated 
whenever an illicit read or write is attempted. Within this 
framework a frotection code could be developed to allow the 
user or process deSigner to specify type of access for any 
subset cf process leveis and/or system users. The security 
available through such a protection system is dependent upon 
the loading of PM memory with descrete blocks from BORAM or 
the IvO Channel. Any skew of the Memory Blocks and the data 
biocks being loaded wouid nullify this protecticn, since 
words from a frotected data block would overlap onto another 
Memory Elock not necessarily having the same header 
informaticn. 


Table IIi. A Sample Hierarchy 


LEVEL NCTES PASKS ASSLICNED 
0 A Process Communications; Process Creéaticn and 
Renoval 
1 E Process Scheduler; Ciock Process 
2 B Segment Control (Memory and Buik Storage 
aLliocarionr) 
3 B I/O Buffering; Memory Channel Control; EORAM 
Control 
Bus Node Process 
5 C System Operator; Library Routines; User 
Processes 
ee 
Notes: A: Nucleus frocesses 
Pee Re PC Uae (banotehable. processes 
ACB lime System (stored 11 ROW 
C3; Transierapie processes 


De sovSTih. ORERA TION 
i. Steady-State Operation 
a. Process Creation and Removal 

System operation may be viewed generally as the 
creation, ccntrol and removal of processes. The nuclei of 
the system act independently, kut collectively, to achieve 
this abstraction. As the najor means of communication among 
higher-level processes, they tend to be the focal fecint of 


control activity. Creation and renoval of other processes is 
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the most powerful form of controi of all and is retained as 
a nucleus function useable globally via primitives, in order 
that the credentials of each process attempting their use 
may be checked. 

It is jmportant to note that the nucleus 
processes are not abie to communicate with each cther via 
the primitives which they irplement. Nor is there any need 
for the zero-ievel processes to converse with other levels 
or With their counterparts on other processors. By the sane 
TOG 1 Cz the entire hucleus Gersts a” prieri and as 
non-destructable: since the creation and d¢estructicn of 
processes is contrelled by the nucleus, operation of this 


function upon the nucleus itseif could Lead to confuSion and 


deadlock. 

The nucleus creates and controls au 
higher-level processes. This relationship serves tc avoid 
ambiguities which could result in deadlock. For example, 


if, 1n response to an interrupt, the nucleus starts creating 
a higher-level process, the receipt of another interrupt 
while response to the original one is under way poses a very 
real protlen, but a controllable one. Once a process has 
been created, 1t may be interrupted and stored. ee 
necessary, the software program on which it was based nay be 
used to create a new programmatically identical process. 
Creation of a process is a krief sequence which involves 
setting aside Memory Space for the input message queue of 
the new process, adding its name to a local iist of known 
processes and notifying the superior bus that a process by 
that name now exists. The Process Scheduler, using its 
table cf existing processes, assures that all interrupted 
processes are ultinateiy re-activated, passed to another 
processor, or renoved from the system. The problem posed by 
the above exanple reduces, then, to assuring that the 
creation process is not interrupted. 
Bb. FErocess Clocking 


The Creaticn/kenoval process is not the only one 





peguibang protection from untimely interruption. The other 
nucleus processes are equally vulnerable. Some means of 
"clcocking'"' each process with respect to tne one proceeding 
on the superior processor must be present, 1¢€., some 
temporal interlock wahich can control the competition of 
these separate processes [Ref. 11, p. 13]. Dijkstra's 
tmutex" operators [Ref. 7, pe. 345) provide a means of 
disabling interrupts while a nucleus process iS active. 
Since the nucleus processes are programmatically very ;Erief, 
the delay in servicing a pending interrupt is not Serious. 
There are four sources for interrupts: the Memory Channel, 
BORAH, EFM Cleck and the Superior PH (i170 Channel, in tke 
case of the Central Bus}. Granting service priority in just 
that order, Memory Channel first, assures that a hyperactive 
Superior cannot overload a subordinate. 

Diewabaalitye ef aw@uScie process to Cade for 
creation of other processes facilitates another method of 
process clockiny, one which avoids the need for DPS tra “eP 
and V operators in the instruction set available to general 
users. whenever a user-defined "*ccmmunity" cf processes is 
created, ie., a group of processes which communicate at 
least in part via a common set of variables, critical 
section problems can be averted by Simultaneously creating a 
eustodia: pro@ess which pesfomms all eritiical “Ssectden 
operatiocrs fren ite input queue and returns advice by 
message. Calis for the creation of these communities, then 
sufficiently welil~defined, can be performed by systen 
compilers directly £roM such higner-level language 
constructs as FORK and JOIN ox DCTOGETHER. 

Clocking may also be accomplished usinc the 
message structure jin problems involving dependent-element 
grid processing, such as heat-transfer through a_e solid. 
Each point cn the grid is represented by its own process. 
Rather than providing a central body of variables and a 
custodial process, here each process can be required to 


"broadcast" significant data {to its orthogonal neighbors, 
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for mmstance) after each iteration. Again, systen compilers 
may prove extremely well-suited to forming such communities. 
Cr Multi programming 

Each PM maintains a table of processes known to 
it. PM's acting as Bus Nodes therefore include in this 
table the identity and (relative) location of processes 
existing on all subordinate processors. Periodically, the 
Process Scheduler is activated in each PH by the Clock 
process. A review 1s made of the processes locally active 
tor selection of the next process to proceed. For the Bus 
Nodes, the Bus Node process has the highest priority, since 
it must scan toe message input ports from sutcrdinate 
processors cn a relatively freguent basis. Processing 
Nodes, having no subordinates to worry abcut, select fron 
mie vemtirety Of their knewn-process table, bunnamg the Bus 
Node process only as a Last resort as the "null" process. 

Another task of the Process Scheduler is to 
review the distribution of processes asSianed ZO 
Subordinates and to initiate transfers from overloaded 
Peamehes under itsWecntrol. Thies) computation must take into - 
account that processes which belong to a process ccmmunity 
(as previously defined) twill run less efficiently if 
asSigned to a single processor. {To avoid this situation, 
community processes must be assigned to separate prcecessors 


initially and then given highest priority to remain there 


pnd removed from the systen. ) In general, 
mnultiprogramging is a "hyperprocess consisting of the 
Process Scheduler and Processor Workload Control. The 


Scheduler has the power to replace a process which is 
blocxed (ky a page fault, for instance) by another which is 
able to run, even if the only replacement is the null 
process. Workload Control allows processes to "float" about 
the system, thereby extending nultiprogramming across Module 
boundries to include the entire systen. 

d. Error Detection and Debug Faciiities 


Perhaps the most difficult aspect to analyze of 
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any system, hypothetical cr otherwise, is its ability to 
ahalyze itself. Errocg detection facilities Must be 
considered thoroughly in the deSign of any modern system, as 
must be its debug facilities, if disasterous developrent and 
Maintenance costS are to be avoided. Of all the design 
features important to the success of these efforts, 
modularity of system design iS critical. [ Ref. 15, p. 548}. 
Without well-defined delineations among the many functional 
parts and levels of control, the detection and localization 
of error conditions boarders on the impossible. TRAE 
ee temipts not omly to offer modularity put also to clearly 
define the methods of cooperation among processes allowing 
swifter isolation af unanticipated interactions. Fault 
detection can be implemented in several areas of concern: 
unauthorized file-entry attempts; unauthorized frocess 
creation/yremoval and conmunications attempts; miter 
processor data parity checks; and processor deadlccks 
(detected Ly periodic assignment of test processes to each 
processor). The message primitives offer a Simple means of 
infcrming dump processes of the time and tlocaticn of 
detected errors without the need to load a new process on 
the (possibly) defective processor. 
2. Non-steady-State Conditions 
a. System Initiaticn 

The Nininun Systen for TREE is stored on ROM in 
each of the Pii's system-wide. The transition from a “coid# 
machine to .a functioning systen iS acccmplished by a 
Bootstrap kKoutine which is also held in ROM but is never 
nade into a process. When power 1S applied tc the 
processor, the operator is allowed to reset the relocation 
registers of the system Nemory Channels and force a fetch of 
the finest Bcctstear inetouetionsfren RON Thereafter, the 
Bootstrap is able to issue the control sequence necessary to 
initialize the MC registers not associated with tne fetching 
of itS own frogran, followed by an initialization of tables 


for the nucleus. Its final act is to yield to the nucleus 
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by calling cn the creation prifitive to create the Frocess 
Scheduler. 

Once active, the Scheduler iS progranmed to 
react to the absence orf other Minimum System processes py 
successively calling for their creation. Eventually the Bus 
Node process is activated and 1s able to determine whether 
it has subordinates. If there are none, the Scheduler is 
notified to reduce the priority of the Bus Ncde precess to 
the lowest possible. At this time, the processors are fully 
Operational and able to accept procesSing aSSignments by 
wel ocking user consoles and enalbing the central I/0 
Channel. 

b. CDegradation and Maintenance 

Systems must be able to adapt themselves to 
progressively worsenjng component fallure without undue side 
effects. Clearly, ina tree-structured system, the conplete 
malfunctioning of a particular node is less tolerable the 
closer it is to the root node. Failure of the rceot node 
(Central Bus) itself is serious, indeed, but not fatal to 
the entire system. The relative independence of each node 
serves to Sustain and protect existing processes while the 
offending processor is reloaded or repiaced. With due 
attenticn tc this possibility in the design of Pi hardware 
and software, removal and replacement of a module cculd be 
effected without shutting down the system. At the cost of 
generality of nodule design, paraliel redundancy can be 
built inte the Central Bus, allowing it to simulate the 
behavior of the standard PM's while providing needed extra 
reliability. 

Cc. Reconfiguration 

As noted in the previous section, the need to 
Close down the entire system while physical connections are 
being madé cr broken iS not absolute. In terms of software, 
the behavior of the Bus Node process facilitates adaptation 
to such instant alterations: a Processing Node can become a 


Bus Node aS soon aS at recognizes a meaningful input from 








one of its previously dormant sSuborainate-comnmunications 
lines. The node may then upgrade the priority of its Bus 
Node process and transfer itS processing load tc the aew 
processor (or branch). Conversely, if all transferable 
processes are withdrawn from a Bus Node's subortinates, the 
sSuktordinates may then be unplugged, causing the Bus Ncde_ to 
revert tc Processing-Node status. Any branch which is 
unplugged prior to being relieved of its transferable 
processes continues to function normally, provided it still 
has electrical power. The demands placed upon 
operating-systen logic to withstand such divisions might be 
great or might be guite trivial, but the prosfect of 
computer systems which are allowed to "grow" and "divide" 


hay well be worth investigation. 
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III. CONCLUSIONS 

omen: LCOMPNGY OF DHESBUS SeOien 

The ultimate guesticn considered in this study has been 
the feasibility of a multiprocessing systen having 
communications as its focal process. The nucleus cf the 
TREE system, together with the functional adaptiveness of 
each module, may be thought of as a "smart LEus," over which 
Virtually all system processes hay communicate. The 
structure of the system permits distribution of ccntrol, 
avoiding the bottleneck of a single bus processor, without 
the necessity for complex data-transfer hardware. This 
Simplicity in har@ware works to the benefit or systen 
reliability. The uniformity of each module's operating 
system provides a very real measure of software reliability 


and maintainability. 


Me GHENERAL~PURPOSE CAPABILITIES 

The versatility of a large system is its strecngest 
juSstificaticn. The growing need for powerful 
multiprocessing systems has prompted some cfferings which 
are less than general in capability, representing a 
departure frem the mainstream of computing development. fhe 
profosed system enables users to create processes 
dynamically and to define their interaction while, at the 
same tine, providing sufficient processing fower tc assure 


hon, thr cughfEut. 


C. VAKIAELE PROCESSING POWER 

A recursively-~expandable system design is offered as a 
solution to the problem of ever-increasing demands on 
processing power. From a practical point of view, the 
capability emerges for a computing center to adjust to its 
volume of work by smaller increments than is fresently 


possible. This adjustment could be downward or upwardward. 


Sha 





ee TECHNOLOGICAL FEASISZILLTY 

The design of the Memory Channel section cf the 
Processing Mcdule has been stated in broad terms and could 
require considerable technical development to make it a 
reality. Of the Channelts two functions, dynamic address 
translation offers less of a problem. Fer the reéemainirg 
functicn, it is not clear that a Switching network can 
economicaliy be devised capable of variously interccnnecting 
BORAM and the Superior Bus Node to an arbitrary number of 
subordinate nodes and Memory Blocks. AS a complex enable 
Circuit, the number of gates required might be rather large. 
Granting that this problem can be resclived, it should be 
noted that all cther components of the Processing Module are 


conventicnal in terms of present or expecteda LSI technology. 


368 








is 


1. 


2s 


3. 


14. 


ho 3 


BIBLIOGRAPHY 


RS 
ba 
KS 

lm 

1O 

Ih 

he 

i 

ts 

(a: 

i) 

to 

Te, 
we 
| 

A 


HoLamson, N., Jutommatio 
MeGraw-Hill, p. ¥Y3=135. 


Boponait, Dep kinninent, D. J., and Edwards, D. E. G., 
"Associative Wemories ih Large Computer Systems," 
tuformaticn Processing 68, Vv. i, p. 7/96-800, North 
Holland, 1969. 


Baer, J. Le, “A Survey of Some Theoretical Aspects of 
Miptiphecessing,, Colputing SUrVeys, Ve. 35, pe 31-80, 
March 1975. 


Control Data Corporation Report PDJ #33, STAR Operating 


7 eet 


System Concepts, 42 pp., 18 September 1565-2 


Balzer, hb. Me, "PORTS ~A Method for Dynanic Interfrogran 
Communication ana Job Control,“ AFIPS Proceedings, SJCC, 
Mew ccoe pee WES-4S9, AFIPS Press, T9/T. 


Dennin Ponds VTE ecnal Menery, Computing Srnveys, v- 
Zs Fe oeede oe Saree nber, 1 . Puts ti ¢ 


Dimiiota. EL. We “TheyStricgtipesor the THE-Multi- 
programming System," Communications of the ACH, v. 11, 
pe stasis, May 15068. 


Farber, D., “Data king Oriented Computer Networks," 
Courant Computer Science So OE 3e kustin, R., ed, 
Dp. 25-93, Prentice-Hall, y7T. 


Gosden, J. Aw, “Explicit Parallel Processing Descriftion 


gece ntrol an Programs for tuiti—- and Uni~processor 
Computers," Arivs e€roceegings, MueG, Veeco, D. 5 5t=6ou7 


= mew eg eee ee QO eal nt am == ae ae ee 


Spartan Books, 1966, 


Hansen, P. B., "fhe Nucleus of a ee ae 
ccs ae Communications of the ACH, Ve t3, pe 238-250, 


LOmtIng, Ge lo. and Randelljey., “Process Structuring," 
Momma SUEVeye, VV. DS, Pe GS-50, Larch 1973. 

HCS-8 Hicro Computer Set Users Manual, rev. 3, Intel 
COrperaclion, Marcrrio7 3. 

Saam, A. C., TRE Zogical Design of Operating Systess, 
(Wratt dated September, 1971) reprinted at the Naval 
MO@eugrdglate Scnool wath permission of the author, p. 
Bee de 3s, 1972. 


University of Kichigan Technical Repo 
Conputer Conaunications Systems, by 
io - tay (905, 


Wichmann, B. Aw, “A Modular Operating 
hrolmation Processing 63, Ve 1, pe 34 
Bi agd., 1369. 


75 Si 400), Hee in 
Det be oe oe 


S 
3 


oo 





INITIAL DISTRIBUTION LIST 


No. 


Defense Documentation Center 
Cameron Station 
Alexandria, Virginia 22314 


library, Code 0212 
Naval Postgraduate School 
Monterey, California 93940 


. Chairman, Computer Science Group, Code 72 


Naval Postgraduate School 
Monterey, California 93940 


Asst Professor G. A. Kildall, Code 72Kd 
Computer Science Group 

Naval Postgraduate School 

Monterey, California 93940 


Asst Professor R. H. Brubaker, Jr., Code 72Bh 
Computer Science Group 

Naval Postgraduate School 

Monterey, California 93940 


LT Richard J. Goodwin, USN 


235 Alder Street 
Pacific Grove, California 93950 


40 


Copies ° 














SECURITY CLASSIFICATION OF THIS PAGE (When Date Entered) 
3 READ INSTRUCTIONS 


» REPORT NUMBER 2. GOVT ACCESSION NO, 3. RECIPIENT'S CATALOG NUMBER 



















S. TYPE OF REPORT & PERIOD COVERED 






TITLE (and Subtitie) 


A Design for a Distributed-Control 
Multiple-Processor Computer System 





Master's Thesis; 







» REPORT MUMBER 





6. CONTRACT OR GRANT NUMEER(®) 









AU THOR(a#) 


Richard James Goodwin 








10. PROGRAM ELEMENT, PROJECT, TASK 
AREA & WORK UNIT NUMBERS 





PERFORMING ORGANIZATION NAME AND ADORESS 









Naval Postgraduate School 
Monterey, California 93940 







12. REPORT DATE 

December, 1973 

13. NUMBER OF PAGES 
ub 






CONTROLLING OFFICE NAME AND ADORESS 






Naval Postgraduate School 
Monterey, California 93940 






4. MONITORING AGENCY NAME & ADORESS(if different from Controlling Office) 15. SECURITY CLASS. (of thia report) 





Uneciassitved 


1Sea, DECL ASSIFICATION/ DOWNGRADING 
SCHEDULE 


16. DISTRIBUTION STATEMENT (of thie Repori) 


Approved for public release; distribution unlimited. 


17. DISTRIBUTION STATEMENT (of the ebetract entered in Block 20, If different from Report) 


16. SUPPLEMENTARY NOTES 


19. KEY WORDS (Continue on reverse aide if necessary and identity by biock number) 


Multiprocessing; multiprogramming; modular design; operating system; process 
concept; process communication; process hierarchy; process creation; process 
removal; process clocking; process interaction; recursion; message primitives; 
file protection; error detection. 


20. ABSTRACT (Continue on reveree aide if neceseary end ideniify by block number) 


A tree-structured multiprocessing system design is proposed in which process 
communication is the primary link between processors. A hardware cluster, 
called a Processing Module, is proposed as the basic structural component. 
These modules literally "plug together" to form a system of arbitrary size. 
Each module has its own memory and runs its own hierarchically-structured 
operating system, the nucleus of which implements P. B. Hansen's communications 
primitives along with process creation and removal. Workload scheduling and 


= > =e “3 a co : 7 


DD i an 73 1473 EDITION OF 1 NOV 65 IS OBSOLETE 


S/N 0102-014- 6601 | ee 
(Page 1) SECURITY CLASSIFICATION OF THIS PAGE (Khen Data Kntered) 


ud 





Cte CURITY CLASSIFICATION OF THIS PAGE(Whon Data Entered) 


process location are performed recursively in the system's tree structure. 
Multiprogramming is implemented system-wide, allowing processes to migrate 
away from overloaded modules. It is argued that the resulting system would 


be truly general-purpose and is subject to no limit on its size and 
consequent computing power. 


DD Form 1473 (BACK) 
ey i 
S/N 0102-014-6601 


SECURITY CLASSIFICATION OF THIS PAGE(Bhen Date Entered) 


42 




















Thesis 14 t 
G97325 Goodwin 

Bc.l A design for a dis- 
tributed-control multj- 


ple-processor computer 
system, 


{8 


ea 


DUDLEY KNOX LIBRARY 


Se 


3 2768 00033041 





